Eager Memory Management for In-Memory Data Analytics
نویسندگان
چکیده
منابع مشابه
Elastic Memory Management for Cloud Data Analytics
We develop an approach for the automatic and elastic management of memory in shared clusters executing data analytics applications. Our approach, called ElasticMem, comprises a technique for dynamically changing memory limits in Java virtual machines, models to predict memory usage and garbage collection cost, and a scheduling algorithm that dynamically reallocates memory between applications. ...
متن کاملThoth in Action: Memory Management in Modern Data Analytics
Allocation and usage of memory in modern data-processing platforms is based on an interplay of algorithms at multiple levels: (i) at the resource-management level across containers allocated by resource managers like Mesos and Yarn, (ii) at the container level among the OS and processes such as the Java Virtual Machine (JVM), (iii) at the framework level for caching, aggregation, data shuffles,...
متن کاملUnderstanding Memory Configurations for In-Memory Analytics
Understanding Memory Configurations for In-Memory Analytics
متن کاملWhere does Memory Go?: Study of Memory Management in JVM-based Data Analytics
1. INTRODUCTION Data analytics clusters are typically set up with a centralized resource manager(RM), e.g. Yarn [29], Mesos [20]. Each application scheduled on the cluster negotiates with the RM for resources. A unit of resources allocated to an application is termed as a container, the size of which is specified by the application at the time of submission. With a lack of any sophisticated too...
متن کاملEager Stack Cache Memory Transfers
The growing complexity of modern computer architectures increasingly complicates the prediction of the run-time behavior of software. For real-time systems, where a safe estimation of the program’s worst-case execution time is needed, time-predictable computer architectures promise to resolve this problem. The stack cache, for instance, allows the compiler to efficiently cache a program’s stack...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEICE Transactions on Information and Systems
سال: 2019
ISSN: 0916-8532,1745-1361
DOI: 10.1587/transinf.2018edl8199